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SUBSTITUTE SPECIFICATION 
The Clean Version 

WEATHER-AGILE RECONFIGURABLE 
AUTOMATIC TARGET RECOGNITION SYSTEM 

DEDICATORY CLAUSE 
[0001] The invention described herein may be manufactured, used and licensed 

by or for the Government for governmental purposes without the payment to us of any 
royalties thereon. 


BACKGROUND OF THE INVENTION 
|0UU2] On many battlefields, well-known target signatures are distorted by real- 

world effects, such as various and varying environmental conditions. Further, new, 
heretofore-unknown targets emerge that need to be defined. As a consequence, updates 
of a target acquisition or automatic target recognition (ATR) knowledge base arc and 
continue to be a necessity for autonomous precision strike weapons. Such autonomous 
precision strike weapons utilize all possible target sensing means except direct laser 
designation of the targets. 

[0003] ATR systems that use some type of pattern recogni tion need some form 

of knowledge or training database resident in the systems for proper operation. Since 
the performance of any ATR system is limited by these training data and often even 
known targets are obscured by camouflage and other means, most real-world 
applications require some real-time updates (i.e. retraining) of the target knowledge 
database. This requirement also holds true for any new mobile or fixed targets. This 
"real-time" retraining is referred to as rapid retraining or rapid target update. 
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[0004] In an ATR system, the typically required information for the pattern 

recognizer consists of target and background/clutter signatures in the electromagnetic 
band of interest. The robustness of ATR performance is usually quantified by correct 
classification of targets in some form, such as recognition or identification and false 
alarms defined as either clutter or misclassifications. The best ATR for any specific 
system application can be selected from known algorithms that are amenable to rapid 
retraining and also appropriate for the timeline for the specific application at hand. To 
maintain the ATR robustness through rapid target updating, however, the ATR must 
have the flexibility to be reconfigured in response to the target scene information 
provided by the surveillance means. Part of this updating process includes establishing 
metrics of the clutter in the target scene so that the criteria on ATR performance can be 
established for the specific target environment. 

[0005] In general, multiple simultaneous weapon engagements are desired to 

eliminate multiple targets in a very short period of time. The rapid retraining of 
multiple weapons is restricted by the limitations of available and compatible sensors. 

SUMMARY OF THE INVENTION 
[0006) Applicants' ATR system is weather-agile because it is comprised of a 

first target sensing means, either singular or plural, that is (are) capable of surveilling 
the target scene in foul or fair weather, and a second target sensing means, comprised of 
a group of sensors. At least one sensor from the group comprising the second target 
sensing means is mounted on one of several available weapons. These sensors can also 
sense targets in either foul or fair weather. Applicants' ATR system makes it possible 
to use dissimilar sensors in surveillance and in the weapons, while not excluding the 
use of similar active or passive sensors when conditions allow. 
[0007] The first and second sensing means communicate through, a control 

center so that ultimately, among the several weapons available, the most strategically 
located (based on its trajectory relative to the selected target) and equipped (relative to 
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the weather) weapon is activated for the destruction of a selected target. The control 
center accomplishes the communication by receiving the sensed target signature from 
the first sensing means, processing the signature using database already resident in the 
center and transmitting the processed target signature to the weapon possessing the 
greatest potential for successfully destroying the target. 

DESCRIPTION OF THE DRAWING 
[0008J Figure 1 illustrates the Weather-Agile Reconfigurable ATR System 

having multi-spectral target sensing means on both the surveillance platform and the 
weapons. 

[0009] Figure 2 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are synthetic aperture radars (SAR's). 
[0010J Figure 3 shows the Reconfigurable ATR system wherein the primary 

target sensor on the surveillance platform is a SAR and the secondary target sensor on 
the weapon is a laser radar. 

[001 1] Figure 4 shows the Reconfigurable ATR system wherein the primary 

target sensor is a SAR and the secondary target sensor is an electro-optical sensor. 
[0012] Figure 5 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are electro-optical sensors. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
[001.3] Refer now to the drawing wherein like numbers represent like parts in 

each of the several figures, solid lines with arrowheads represent signal paths and 
dotted lines with arrowheads represent the weapon trajectory. With reference to the 
drawing, different combinations of various types of primary and secondary sensing 
means are presented for changeable climatic conditions. 

[0014] Figure 1 is a diagram of the Weather-Agile Reconfigurable ATR System 

having multi-spectral target sensing means on both the surveillance platform and on the 
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weapons. The primary sensing means is multi-spectral sensor 101 mounted onto 
airborne surveillance platform 105 from which it surveils target scene 1 09 through any 
kind of weather that may exist between the platform and the target scene. From this - 
surveillance activity, the multi-spectral sensor produces target signature information 
that is descriptive of the type of target detected. This target signature information is 
downlinked to control center 111, also through any kind of weather condition. 
[0015J The control center has therein pre-existing database which pertains to, 

among others, target spectra, terrain and material classification, topography, 
atmospheric correction for converting radiance to reflectance, the capabilities and 1 
limitations of the sensing means on the available weaponry and the location of the 
weaponry. The control center transmits this database, to the extent practical, to 
surveillance platform 105 to optimize the transfer between the primary sensing means 
and the control center of the most useful information for rapid retraining. 
[0016] Upon receipt of the target signature information, the control center 

processes (reformats) the information to discover the type and location of the detected 
target and selects, among available weapons 107, the particular weapon that is most 
likely to succeed in destroying the detected target. The likelihood of success is 
determined based on the location of the weapon, its predicted trajectory relative to the 
location of the target and the weapon's destructive capabilities. The selected weapon 
confirms to the control center the receipt of the update. Thereafter, the weapon is 
launched toward the target. In the embodiment shown in Figure 1, the suitability of 
secondary sensing means 103 on the weapon for detection of the target through the 
weather encompassing the trajectory is deemed irrelevant since it is a multi-spectral 
sensor capable of functioning in all weather conditions. 

[0017J Figure 2 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are synthetic aperture radars (SAR) 201 and 203, 
respectively. Such active sensors of the same type being used together offers the highest 
potential for image matching of spatial features. If SAR sensors having different 
resolutions (example: higher resolution on the surveillance producing a finer or higher- 
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resolution image, and lower resolution on the weapons producing a coarser or lower- 
resolution image) arc used, the two different resolution images of the same scene can be 
fused using the method taught by Mario Costantini et al. in their article "The Fusion of 
Different Resolution SAR Images," in the PROCEEDINGS OF THE IEEE, vol. 85, No. 
1, pages ) 39-1.46. The objective of the Costantini method is to fuse two different spatial 
resolution SAR images to provide a fused image with improved ability to detect point 
scatterers in a uniform background. Since SAR images are acquired in range-dopplcr 
coordinate system, both images must be acquired in this coordinate system. Both the 
high-resolution and the low-resolution instruments collecting the images are digital 
instruments, and the fusion process is pixel level fusion in contrast with other fusion 
methods; for example, feature level ftision. In the Costantini method, the fusion of the 
two images is carried out by obtaining the image which has the least mean square 
deviation from the finer-resolution image. The higher-resolution image may be viewed 
as the reference image on which the fusion process takes place, but a pre-requisite is that 
the two images be co-registered. The expected intensity of the lower resolution image is 
then constrained to be the local average of the expected intensity of the higher-resolution 
image. The relative variance of the two images is introduced to adaptively adjust the 
weight of intensity. The result sought is a reconstruction of the expected image intensity 
at the finer-resolution which is less noisy than that given by the finer-resolution image 
intensity above. The minimization problem with MN independent variables can be 
decomposed in MN/mn independent variables. So, in the Costantini method, a Cartesian 
coordinate system is used to describe an image surface in (x,y). From this surface, a (x,y) 
and 0 (x,y) describe the amplitude and phases, respectively, of the signals received by the 
two digital instruments, one with a complex impulse response h (x,y) - the higher 
resolution instrument; and the second with a complex impulse response h' (x,y) - the 
lower resolution instrument. The "width" of the impulse response defines the spatial 
resolution of the two instruments. The imaging pixels of the two instruments are 
arranged in parallel with the coordinates of the imaging surface. The pixels of the higher 
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resolution instrument have dimensions, Ax and Ay, with reference at Xo, y<>. The 
following definition of symbols applies hereinafter: 

x, y : the coordinates of the imaged surface; positive real numbers. 

Ax, Ay : pixel dimensions of the higher resolution image; positive reaJ numbers. 

x 0 , y 0 : the lower left corner of the imaged surface (the zero point of the 
coordinate system). 

Xj » x 0 + iAx and y } = y 0 + j Ay refer to the i, j pixels of higher resolution image. 
M, N refers to the higher resolution instrument pixel,elements. 
m, n refers to the lower resolution instrument pixels, 
(i j) refers to the higher resolution image, 
(i', j 1 ) are the labels for the lower resolution instrument. 
R„ R y are positive numbers defining the resolution of the higher resolution 
instrument along the two coordinates x, y. 

Using the above, the pixels in the higher resolution instrument are identified as follows: 

(1) (ij),i = <U — M- l,j=0,l,»N-l 

For the lower resolution instrument, the pixels arc identified as: 

(2) (i'j') t i: = 0, 1 — — - 1, j' = 0, 1 — — - 1 

m n. 

Where — and — are the ratios between the coarser and finer resolution cells. 
m n 

With the identification of the geometric relationship between the two-dimensional pixel 
array of the higher resolution instrument and imaging surface, the complex value of the 
image is: 

dj - £ £ h (x - xj, y-yj) a (x 5 y)exp (ie(x,y)) dxdy (higher resolution) 

The image intensity is: 

ljj= \c ti \ (higher resolution) 

(3) The expected value of image intensity is: 
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</„ ) = [ [ | h(x- Xj , y-y*) 1 2 (I a ( x ' y A* ) dxdy (higher resolution) 

From equation (2), the coordinates of the pixels of the lower resolution instrument are 
identified; which leads to: 

(4 ) x,'=Xo+ (m " 1)Ax ^i'mAx 

(5) y'j' = yo+ ( "~ 2 1)Ajr + J'nAy 

These two equations assume that the two images are co-registered. From this, the 
expected intensity of the lower resolution instrument is obtained: 

(6) W>*ff |h , (x-Xi i i y-yj , )| 2 (M**^) dxdy 

The two images of the same scene are statistically independent, and the relative vari ance 
of the two images are: 

(7) v = ~Q Higher Resolution Image (independent of ij) 

(fcy-( /l .y))0 

(8) v = ^— I 2 Lower Resolution Image (independent of i' j') 

<('<'/ )> 

The square of the absolute value of the impulse responses of the two instruments are: 
/ 

(9) |h(x,y)| 2 = faRy for |x| < Rx f |y| <Ry Higher Resolution Instrument 

JL 

(10) and |h'(x,y)| 2 * mn |h(x/m, y/m)| 2 Lower Resolution Instrument 
By combining (3), (6), (9) and (1 0), the result is 


That is, the expected intensity of the lower resolution image is the local average of the 
higher resolution image. The fusion of the two image intensities is obtained as the 
solution to the following minimization problem: 
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5 5 (*.-'♦) 1 

Subject to the constraints: 

L, 2 x » „• l "f + „ 2- 2 

*tt ttTvr _ V V jgm 1*1'* 

(13) W « " / + m« 

V V 

And: 

(14) Xij >0 

Where, in (13) i=0, 1-M/m-l. j-0, 1— N/n-1 - and in (14) i=0,l. -M-l andj-0,1, — N- 
1 

Equation (13) enforces the condition that the expected image intensity of the coarser 
resolution instrument must be the appropriate weighted average (with weights ~> and 

mn . 

~ of the coarser resolution estimated from the two images. Equation (14) indicates 

that the intensity is always positive. The minimization problem with MN independent 
variables can be decomposed in MN/mn independent variables. The sub-problems are 
labeled: i' - 0, 1, — M/m - 1 , j' - 0, 1 , — NM -1 . The (i', j')th sub-problem is the 
following: 

(15) 22. Is S 2 

^ HI 

Subject to the constraints of ( 1 3) and 

(16) X kl2 :o 

Where, in (16) : k= i'm, i'm + 1, — (i' + 1) m - 1 

l=j' n> j'n+l— Cj'+l) -1 
By thusly performing a fusion of the images as taught by Costantini et al, a better match 
between the sensors can be achieved. 
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[0018J The SAR-to-SAR configuration is particularly useful when, both sensors 

must operate in foul weather because when the weather is poor, electro-optical sensors 
or hyperspectral sensors provide little or no capability. In Figure 2, SAR imagery is 
collected over target scene 109 in foul weather indicated by clouds 205. In addition to 
clouds, the foul weather can be fog or rain. The SAR image collected must include 
both potential targets, confusers and clutter so that eventually a high level of precision 
strike can be performed with virtually zero false alarms and avoid unintended targets. 
The collected SAR imagery is compressed and down-linked to the control center with 
the position coordinates of the potential targets or "regions of interest 91 and the position 
of the surveillance platform relative to the available weapons. Upon receipt, the control 
center decompresses the imagery, performs coordinate transformation for a specific 
weapon trajectory and performs the discrimination and classification processes using 
synthetic discrimination function filter. From this is derived the target spatial 
information which is formatted to allow rapid retraining of weapons with synthetic 
aperture radar 203. It is noted that in the future, the control center itself may potentially 
be eliminated or bypassed and its functionality placed either at first or second sensing 
means or partitioned between the two. This direct communication between the sensing 
means would help minimize the latency and result in improved target elimination 
timeline. 

[0019] The target spatial information derived by the control center can also be 

transmitted to weapons with laser radar 301 or electro-optical or hyperspectral sensor 
401, as illustrated in Figures 3 and 4, respectively, if the weather encompassing the 
selected weapon trajectory is fair. A method for fusing SAR and hyperspectral image 
data sets over the same area is taught by Su May Hsu et al. in "SAR and HSI Data 
Fusion for Counter CC&D," The Record of the IEEE 1999 Radar Conference, pages 
2 1 8-220. The article describes the Hsu method as it was practiced on a collection of 
images of suspected target vehicles obtained by the Foliage Penetration SAR and 
hyperspectral images (HSI) of camouflage nets and other background terrain 
characteristics obtained by the hyperspectral sensor. In the Hsu method, the SAR and 
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HSI data are first processed separately for detection of target objects and terrain 
classification, respectively. SAR data is processed with pixel grouping and 
thresholding for target detection. The terrain classification and spectral feature 
extraction in HSI data is accomplished by reducing the dimensionality of the HSI data. 
The reduction of the dimensionality is performed by first obtaining Eigenvectors and 
then using the Eigenvectors to transform HSI data into principaJ components, also 
known as Eigenimages. Principal component transform allows the segregation of noise 
components and the determination of the inherent dimensionality of the HSI data. 
Using iso-data clustering, terrain features, such as trees, roads and camouflage nets can 
be distinguished and mapped. To combine the SAR and HSI data, co-registration is 
first performed with reference to terrain features using scaling, rotation and translation 
operations. Then, fusion process follows based on the co-registered images. SAR 
detections that coincide with HSI identifications as trees or camouflage nets, for 
example, are eliminated as false alarms, thus increasing the accuracy of the target 
detection by SAR. 

10020] If the weather conditions allow, use of purely passive sensors such as 

electro-Optical sensors 501 and 401 is highly desirable because it minimizes the 
potential of alerting the targets during multiple simultaneous weapon engagements. 
This is illustrated in Figure 5. Substitution of the electro-optical sensors with 
hyperspectral sensors may afford the ability to detect specific materials used in a target 
object. 

[0021] The embodiment, depicted in Figure 1, utilizing multi-spectral sensors 

both on the surveillance platform and on the non-reusable weapons may entail 
substantial costs. An alternative is to use simultaneously the combinations of various 
types of primary (on the surveillance platform) and secondary (on the weapons) sensing 
means as described above with reference to Figures 2 through 5. Many surveillance 
platforms having thereon various types of primary sensing means may be deployed, all 
communicating with a common control center. Likewise, many groups of weapons can 
be positioned at various locations, each group in turn comprising multiple weapons 
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having different secondary sensing means. In this way, great flexibility is built into the 
Weather-Agile Reconfigurable ATR system to achieve the least wasteful and most 
accurate precision strikes against selected targets. 

[00221 Although a particular embodiment and form of this invention has been 

illustrated, it is apparent thai various modifications and embodiments of the invention 
may be made by those skilled in the art without departing from the scope and spirit of 
the foregoing disclosure. Accordingly, the scope of the invention should be limited 
only by the claims appended hereto. 
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SUBSTITUTE SPECIFICATION 
The Markcd-Un Version 

WEATHER-AGILE RECONFIGURABLE 
AUTOMATIC TARGET RECOGNITION SYSTEM 

DEDICATORY CLAUSE 
[0001 ] The invention described herein may be manufactured, used and licensed 

by or for the Government for governmental purposes without the payment to us of any 
royalties thereon, 

BACKGROUND OF THE INVENTION 
[0002] On many battlefields, well-known target signatures are distorted by real- 

world effects, such as various and varying environmental conditions. Further, new, 
heretofore-unknown targets emerge that need to be defined. As a consequence, updates 
of a target acquisition or automatic target recognition (ATR) knowledge base are and 
continue to be a necessity for autonomous precision strike weapons. Such autonomous 
precision strike weapons utilize all possible target sensing means except direct laser 
designation of the targets. 

[0003] ATR systems that use some type of pattern recognition need some form 

of knowledge or training database resident in the systems for proper operation. Since 
the performance of any ATR system is limited by these training data and often even 
known targets are obscured by camouflage and other means, most real-world 
applications require some real-time updates (i.e. retraining) of the target knowledge, 
database. This requirement also holds true for any new mobile or fixed targets. This 
"real-time" retraining is referred to as rapid retraining or rapid target update. 
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[0004] In an ATR system, the typically required information for the pattern 

recognizer consists of target and background/clutter signatures in the electromagnetic 
band of interest. The robustness of ATR performance is usually quantified by correct 
classification of targets in some form, such as recognition or identification and false 
alarms defined as either clutter or misclassifications. The best ATR for any specific 
system application can be selected from known algorithms that are amenable to rapid 
retraining and also appropriate for the timeline for the specific application at hand. To 
maintain the ATR robustness through rapid target updating, however, the ATR must 
have the flexibility to be reconfigured in response to the target scene information 
provided by the surveillance means. Part of this updating process includes establishing 
metrics of the clutter in the target scene so that the criteria on AI R performance can be 
established for the specific target environment. 

[0005] In general, multiple simultaneous weapon engagements are desired to 

eliminate multiple targets in a very short period of time. The rapid retraining of 
multiple weapons is restricted by the limitations of available and compatible sensors. 

SUMMARY OF THE INVENTION 
[0006] Applicants 1 ATR system is weathcr-agile because it is comprised of a 

first target sensing means, either singular or plural, that is (are) capable of surveilling 
the target scene in foul or fair weather, and a second target sensing means, comprised of 
a group of sensors* At least one sensor from the group comprising the second target 
sensing means is mounted on one of several available weapons. These sensors can also 
sense targets in either foul or fair weather. Applicants' ATR system makes it possible 
to use dissimilar sensors in surveillance and in the weapons, while not excluding the 
use of similar active or passive sensors when conditions allow. 
[0007J The first and second sensing means communicate through a control 

center so that ultimately, among the several weapons available, the most strategically 
located (based on its trajectory relative to the selected target) and equipped (relative to 
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the weather) weapon is activated for the destruction of a selected target. The control 
center accomplishes the communication by receiving the sensed target signature from 
the first sensing means, processing the signature using database already resident in the 
center and transmitting the processed target signature to the weapon possessing the 
greatest potential for successfully destroying the target. 

DESCRIPTION OF THE DRAWING 
[0008] Figure 1 illustrates the Weather- Agile Reconfigurable ATR System 

having multi-spectral target sensing means on both the surveillance platform and the 
weapons. 

[0009] Figure 2 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are synthetic aperture radars (SAR's). 
[0010] Figure 3 shows the Reconfigurable ATR system wherein the primary 

target sensor on the surveillance platform is a SAR and the secondary target sensor on 
the weapon is a laser radar. 

|001 1] Figure 4 shows the Reconfigurable ATR system wherein the primary 

target sensor is a SAR and the secondary target sensor is an electro-optical sensor, 
[0012] Figure 5 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are electro-optical sensors. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0013| Refer now to the drawing wherein like numbers represent like parts in 

each of the several figures, solid lines with arrowheads represent signal paths and 
dotted lines with arrowheads represent the weapon trajectory. With reference to the 
drawing, different combinations of various types of primary and secondary sensing 
means are presented for changeable climatic conditions. 

[0014] Figure 1 is a diagram of the Weather-Agile Reconfigurable ATR System 

having multi-spectral target sensing means on both the surveillance platform and on the 
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weapons. The primary sensing means is multi-spectral sensor 101 mounted onto 
airborne surveillance platform 1 05 from which it surveils target scene 109 through any 
kind of weather that may exist between the platform and the target scene. From this 
surveillance activity, the multi-spectral sensor produces target signature information 
that is descriptive of the type of target detected. This target signature information is 
downlinked to control center 111, also through any kind of weather condition. 
[0015] The control center has therein pre-existing database which pertains to, 

among others, target spectra terrain and material classification, topography, 
atmospheric correction for converting radiance to reflectance, the capabilities and 
limitations of the sensing means on the available weaponry and the location of the 
weaponry. The control center transmits this database, to the extent practical, to 
surveillance platform 105 to optimize the transfer between the primary sensing means 
and the control center of the most useful information for rapid retraining. 
[0016] Upon receipt of the target signature information, the control center 

processes (reformats) the information to discover the type and location of the detected 
target and selects, among available weapons 107, the particular weapon that is most 
likely to succeed in destroying the detected target. The likelihood of success is 
determined based on the location of the weapon, its predicted trajectory relative to the 
location, of the target and the weapon's destructive capabilities. The selected weapon 
confirms to the control center the receipt of the update. Thereafter, the weapon is 
launched toward the target. In the embodiment shown in Figure 1 , the suitability of 
secondary sensing means 103 on the weapon for detection of the target through the 
weather encompassing the trajectory is deemed irrelevant since it is a multi-spectral 
sensor capable of functioning in all weather conditions, 

[0017] Figure 2 shows the Reconfigurable ATR system wherein both the 

surveillance and weapon sensors are synthetic aperture radars (SAR) 201 and 203, 
respectively. Such active sensors of the same type being used together offers the highest 
potentiaJ for image matching of spatial features. If SAR sensors having different 
resolutions (example: higher resolution on the surveillance producing^* finer or higher- 
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resolution image^ and lower resolution on the weapons producing a coarser or lower- 
resolution image) are used, the two different resolution images of the same scene can be 
fused using the method taught by Mario Costantini et al. in their article "The Fusion of 
Different Resolution SAR Images," in the PRO CEE D INGS OF TH E4EES 
PROCEEDINGS OF THE IEEE , vol. 85, No. 1 , pages 139-146. The objective of the 
Costantini method is to fuse two different spatial res olution SAR images to provide a 
fused image with improved ability to d etect point scattered in a uniform background. 
Since SAR images are acquired in range-doppler co ordinate system, both images mustbe 
acquired in this coordinate system. Both the high-resolution and the low-resolution 
instruments collectingjhe images are digital instruments, and the fusion process is pixel 
level fusion in contrast with other fusion methods: for example, feature level fusion. In 
the Costantini method, the fusion of the two images is carried out by obtaining the image 
which has the least mean square deviation from the finer-resolution image. The higher- 
resolution image may be viewed as the reference image on which the fusion process takes 
place, but a pre-requisite is that the two images be co-registered. _The expected intensity 
of the lower resolution image is then constrained to be the local average of the expected 
intensity of the higher-resolution image. The relative variance of the two imacssJs 
introduced to adaptivelv adjust the weight of intensity. Th e result sought is a 
reconstruction of the expected image intensity at the finer-resolution which is less_noisy 
than that given by the finer-resolution image intensity above. The minimization problem 
with MN independent variables can be decomposed in MN/mn independent variables. 
So, in the Costantini method, a Cartesian coordinate system is used to describe an image 
surface in (x.vV From this surface, a (x.y) and 0 fx.v) describe the amplitud e and phases. 
respectively, of the signals recei ved by the two_digital instruments, one with a complex 
impulse response h (x.y) - the higher resolution instrument: and the second with a 
complex impulse response h'(x.y) _^the lower reso lution instrument. The "width" of the 
impulse response defines the spatial resolution of the two instruments. T he imaging 
pixels ofthe two instruments are arranged in parallel with the coordinates o f the imaging 
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surface._J_he pixels of the higherrcsolution instnimentjhave dimensions. Ax an d Av. with 
reference at x^ v^. The following definition of symbols applies hereinafter: 
x. v : the coordinates of the imaged surface; positive real numbers, 

m Ax. Ay : pixel dimensions of the higher resolution image: positive real numbers. 

Xfr v Q : the lower left corner of the imaged surface (the zero point of the 
coordinate system). 

x t - = x„ + iAx and Vj = v„ + i Av refer to the i. i pixels of higher resolu tion image. 

^4. jsj refers to the higher resolution instrument pixel elements. 

m, n refers to the lower resolution instrument pixels. 

(i j) refers to the higher resolution image. 

(i'. V) arc the labels for the lower resolution instrument 

R^.JRy are positive numbers defining the resolution of the higher resolution 

instrument along the two coordinates x. v. 

Using the above, the pixels in the higher resolution instrument are identified as follows: 

m mu = o.L---M-i,i-<u.--N-i 

For the lower resolution instrument, the pixels are identified as: 

(2] (m. i' = 0.l~ — ■Ki , = Q.l- — -1 

m n 

M N 

Where, — _and — are the ratios between the coarser and finer resolution cells. 
m ' n 
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With the identification of the geometric relationship between the two-dimensional pixel 
array of the higher resolution instrument and imaging surface, the complex value of tk 
image is: 

C tt - f [ h fx ■ x>, v-v<) a (x.v)exp (i0(x VI) dxdv (higher resolution) 

The image intensityjs: 

I(j = |C fJ | (higher resolution) 

(3) The expected value of imafte intensity is: 

{I fJ )^[[ | hfx-x, . v-vi) | 2 fl Q fc y) f) dxdv (higher resolution) 

From equation (2). the coordinates of the p ixels of the lower resolution instrument are 
identified: which leads to: 

These two equations assume that the two images are co-registered,. From this, the 
expected intensity of the lower resolution instrument is obtained: 

£6) W)- =lf f | h' (x-x.'« v-v/) 1 2 dxdy 

The two images of the same scene are statistically independent and the relative variance 
of the two images are: 

(7^ v = fc^ Higher Resolution Image (independent of Li) 

/(/ • •_(/'/ <)}\. 

j^j_v=_VLli N - i ' '- Lower Resolution Image (independent of i' i ') 

The square of the absolute value of the impulse responses of the two instruments arc: 
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/ 

(9) \h(x^\ 2= fogy for Ix^ Rx ^ Ry Higher Resolution Instrument 

_/_ 

(10) and lh'(x,y)l 2= mn Ihfx/m. v/m)| 2 Lower R esolution Instalment 
By combining (3). (6). (9) and (10), the resul_t_ls 

That is, the ex pected intensity of the lower resolution image is the local average of the 
higher t^solutionJmetge. The fusion of the two image intensities is obtained as the 
solution to the following minimization problem: 

Subject to the constraints: 

Z Z I Z 

V V 

And: 

041X^0 

WhereJn(13)iK L I--M/m-L i=0. 1— : and in ( 14)i=0.h -M-l and HQ»h — N- 
I 

Equation (1 3) enforces the condition that the expected image_intensitv of the coarser 

i_ 

resolMonJnstrument must be the appropriate weighted average (with weights ^ and 
mn 

v of the coarser resolution estimated from the two images. Equation f 14) indicates 

that the intensity is always positive. The minimization problem with MN independent 
variables can be decomposed in MN/mn independent variables. The sub-problems are 
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labeled; i 1 = 0. K ~ M/m - Li' » 0. L ~N/n -I The (i\ nth sub-problem is the 
following: 

Subject to the constraint s of (13) and 
(16) Xjci^o 

Where, in (16) : k = i'm. i'm ± K — (i' ± ]) m - 1 

i°riLi'n + i - n '^n -i 

By fesk re thusly performing a fttsion of the i mages as taught by Costantini et ah a 
better match between the sensors can be achieved. Aeeerd kigly, th e fusion toohniquoo 
doocribod in th e -oFtiolo aro incorporated heroin ? 

(0018) The SAR-to-SAR configuration is particularly useful when both sensors 

must operate in foul weather because when the weather is poor, electro-optical sensors 
or hyperspectrul sensors provide little or no capability- In Figure 2, SAR imagery is 
collected over target scene 109 in foul weather indicated by clouds 205. In addition to 
clouds, the foul weather can be fog or rain. The SAR image collected must include 
both potential targets, confusers and clutter so that eventually a high level of precision 
strike can be performed with virtually zero false alarms and avoid unintended targets. 
The collected SAR imagery is compressed and down-linked to the control center with 
the position coordinates of the potential targets or <% regions of interest" and the position 
of the surveillance platform relative to the available weapons. Upon receipt, the control 
center decompresses the imagery, performs coordinate transformation for a specific 
weapon trajectory and performs the discrimination and classification processes using 
synthetic discrimination function filter. From this is derived the target spatial 
information which is formatted to allow rapid retraining of weapons with synthetic 
aperture radar 203. It is noted that in the future, the control center itself may potentially 
be eliminated or bypassed and its functionality placed either at first or second sensing 
means or partitioned between the two. This direct communication between the sensing 
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means would help minimize the latency and result in improved target elimination 
timeline. 

100 19J The target spatial information derived by the control center can also be 

transmitted to weapons with laser radar 301 or electro-optical or hyperspectral sensor 
401 , as illustrated in Figures 3 and 4, respectively, if the weather encompassing the 
selected weapon trajectory is fair. A method for fusing SAR and hyperspectra) image 
data sets over the same area is taught by Su May Hsii et al in U SAR and HSI Data 
Fusion for Counter CC&D," BiafiS§g&af&g Igfrfr t W-fi^ 
Record of the IEEE 1999 Radar Conference* pages 2 1 8-220. The article describes the 
Hsu method as it was practiced on a collection of images of suspected target vehicles 
obtained bv the Foliage Penetration SAR and hyperspectral images (HSDof 
camouflage nets and other background terrain characteristics obtained by the 
hyperspectral sensor. In the Hsu method, the SAR and HSI data are first processed 
separately for detection of target objects and terrain classification, ^respectively. SAR 
data is processed with pixel grouping and thresholding for target detection,, Thc_terr_ain 
classification and spectral feature extraction in HSI data is accomplished by reducing 
the dimensionality of the HST data. The reduction of the dimensionality is performed 
by first obtaining Eigenvectors and then using the Eigenvectors to transform HSI data 
into principal components, also known as Eigentmages. Principal component transform 
allows the segregation of noise components and the determination of the inherent 
dimensionality of the HSI data. Using iso-data clustering, terrain features^ such as 
trees, roads and camouflage nets can be distinguished and mapped. To combine the 
SAR and HSI data, co-registration is first performed with reference to terrain features 
using scaling, rotation and translation operations. Then, fusion process follows based 
on the co-registered images. SAR detections that coincide with HSI identifications as 
trees or camouflage nets, for example, are eliminated, as false alarms, thus increasing 
the accuracy of the target detection by SAR, Th e r e for e , th e m e thod of oo - r e gkt e ^ ne 
th e images using references to torruin featur e s, as described in the Hsu artioto, is 
incorporated herein, 
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{0020] If the weather conditions allow, use of purely passive sensors such as 

electro-optical sensors 501 and 401 is highly desirable because it minimizes the 
potential of alerting the targets during mul tiple simultaneous weapon engagements. 
This is illustrated in Figure 5. Substitution of the electro-optical sensors with 
hyperspectral sensors may afford the ability to detect specific materials used in a target 
object. 

[0021] The embodiment, depicted in Figure 1 , utilizing multi-spectral sensors 

both on the surveillance platform and on the non-reu$able weapons may entail 
substantia] costs. An alternative is to use simultaneously the combinations of various 
types of primary (on the surveillance platform) and secondary (on the weapons) sensing 
means as described above with reference to Figures 2 through 5. Many surveillance 
platforms having thereon various types of primary sensing means may be deployed, all 
communicating with a common control center. Likewise, many groups of weapons can 
be positioned at various locations, each group in turn comprising multiple weapons 
having different secondary sensing means. In this way, great flexibility is built into the 
Weather-Agile Reconfigurable ATR system to achieve the least wasteful and most 
accurate precision strikes against selected targets. 

|0022] Although a particular embodiment and form of this invention has been 

illustrated, it is apparent that various modifications and embodiments of the invention 
may be made by those skilled in the art without departing from the scope and spirit of 
the foregoing disclosure. Accordingly, the scope of the invention should be limited 
only by the claims appended hereto. 
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